AdaTriplet-RA: Domain matching via adaptive triplet and reinforced attention for unsupervised domain adaptation
نویسندگان
چکیده
Unsupervised domain adaptation (UDA) is a transfer learning task where the annotations of source are available, but only have access to unlabeled target data during training. Previous methods minimise gap by performing distribution alignment between and domains, which has notable limitation, i.e., at level, neglecting sample-level differences, thus preventing model from achieving superior performance. To solve this, we improve UDA with an inter-domain matching scheme. We apply widely-used Triplet loss match samples. reduce catastrophic effect inaccurate pseudo-labels generated training, propose novel uncertainty measurement method use this select reliable automatically. As selection uncertainty-aware, pseudo labels progressively refined as training performed. advanced Gumbel Softmax technique realise adaptive Top-k scheme achieve selection. enable global ranking optimisation within one batch for matching, whole optimised via reinforced attention mechanism, using Average Precision (AP) reward. Our AdaTriplet-RA achieves State-of-the-art results on several public benchmark datasets, its effectiveness validated comprehensive ablation study. improves accuracy baseline 9.7% (using ResNet-101 backbone network) 6.2% (ResNet-50) VisDa dataset 4.22% DomainNet dataset. The code publicly available at: https://github.com/shuxy0120/AdaTriplet-RA.
منابع مشابه
Deep Unsupervised Domain Adaptation for Image Classification via Low Rank Representation Learning
Domain adaptation is a powerful technique given a wide amount of labeled data from similar attributes in different domains. In real-world applications, there is a huge number of data but almost more of them are unlabeled. It is effective in image classification where it is expensive and time-consuming to obtain adequate label data. We propose a novel method named DALRRL, which consists of deep ...
متن کاملSample-oriented Domain Adaptation for Image Classification
Image processing is a method to perform some operations on an image, in order to get an enhanced image or to extract some useful information from it. The conventional image processing algorithms cannot perform well in scenarios where the training images (source domain) that are used to learn the model have a different distribution with test images (target domain). Also, many real world applicat...
متن کاملBoosting for Unsupervised Domain Adaptation
To cope with machine learning problems where the learner receives data from different source and target distributions, a new learning framework named domain adaptation (DA) has emerged, opening the door for designing theoretically well-founded algorithms. In this paper, we present SLDAB, a self-labeling DA algorithm, which takes its origin from both the theory of boosting and the theory of DA. ...
متن کاملUnsupervised Transductive Domain Adaptation
Supervised learning with large scale labeled datasets and deep layered models has made a paradigm shift in diverse areas in learning and recognition. However, this approach still suffers generalization issues under the presence of a domain shift between the training and the test data distribution. In this regard, unsupervised domain adaptation algorithms have been proposed to directly address t...
متن کاملRobust Unsupervised Domain Adaptation for Neural Networks via Moment Alignment
A novel approach for unsupervised domain adaptation for neural networks is proposed that relies on a metricbased regularization of the learning process. The metric-based regularization aims at domain-invariant latent feature representations by means of maximizing the similarity between domainspecific activation distributions. The proposed metric results from modifying an integral probability me...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Signal Processing-image Communication
سال: 2023
ISSN: ['1879-2677', '0923-5965']
DOI: https://doi.org/10.1016/j.image.2023.117024